Papers by Jin L.C. Guo
Better Language Models of Code through Self-Improvement (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models for code (PLMCs) are pre-taught on large datasets with multi-modal objectives, but fine-tuning them requires extensive supervision and is limited by the size of the dataset provided. |
| Approach: | They propose a data augmentation framework that utilizes knowledge from the pre-training and fine-tuning stage to augment training data, which is then used for the next step. |
| Outcome: | The proposed framework significantly improves pre-trained language models’ performance in sequence-generation tasks, such as code summarization and code generation in the CodeXGLUE benchmark. |